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(57) A dynamically configurable system and method 
for transcoding streaming data and a telecommunica- 
tions infrastructure incorporating the system or the 
method. In one embodiment/the system includes: (1) 
first, second and third streaming conversion modules 
capable of converting data stream portions between 
internal data formats and (2) a transcoding controller, 
associated with the first, second and third streaming 
conversion modules, that determines source and desti- 
nation data formats of the data stream and arranges 
ones of the first, second and third streaming conversion 
modules in an optimal series to convert portions of the 
data stream from the source data format through at 
least one of the internal data formats to the destination 
data format. 




00 

<0 
CM 
O 



CL 
LU 



Printed by Xerox (UK) Business Services 
2.167 (HRSV3.6 



1 



EP1 026 872A1 



2 



Description 

Technical Field Of The Invention 

[0001 ] The present invention is directed, in general, 
to data conversion and, more specifically, to a system 
and method for transcoding streaming data and a tele- 
communications infrastructure incorporating the system 
or the method. 

Background Of The Invention 

[0002] Almost from their beginning, computer sys- 
tems were incompatible with each other. The computer 
systems used different formats to store and communi- 
cate data. Users had to develop individual conversion 
routines to convert the formats used by the other sys- 
tems into a format that their computer system could 
process. Soon thereafter, companies developed utility 
programs that contained a collection of these conver- 
sion routines. The utility programs allowed the user to 
select and execute a single conversion routine from a 
list of conversion routines. 

[0003] With the advent of multimedia data process- 
ing, the problem of information incompatibility became 
more prevalent and complex. Instead of only dealing 
with the incompatibility of computer formats for the 
same type of information, multimedia environments 
added incompatibility between multiple types of infor- 
mation. For example, within multimedia environments 
there may be voice-mail formats, video formats, audio 
formats, facsimile formats, and computer data formats. 
[0004] Later-developed conversion programs 
allowed users to convert from one multimedia format to 
another multimedia format. However, these conversion 
programs still required the user to know ahead of time 
the type of conversion required for each step of the con- 
version process. If a user wants to convert a voice mail 
message, the user might start with a speech-to-text 
conversion program that converts the voice mail mes- 
sage to text. Suppose storage space is critical, then the 
user would use another program to compress the newly 
created text file. 

[0005] Further suppose the user determines that 
the previously stored message is confidential. The user 
would then use a program to decompress the file. Then 
the user would use another program to encrypt the text 
message. Last but not least, the user would use still 
another program to compress the encrypted file. 
[0006] Now the user wants to send the file to 
another person on a different computer system. This 
brings a problem on the recipient. The recipient is 
required to determine which conversion programs to 
use and in what order. However, the recipient may not 
have a particular, required conversion routine. The 
recipient has to determine what conversion programs 
are available and what type of source formats the pro- 
grams can convert. Then the recipient is forced to deter- 



mine what combination of conversion programs can be 
used to convert from the source format to the desired 
destination format. Once the recipient has done these 
steps several times, the recipient has to manually step 
5 through each conversion routine until the desired desti- 
nation format is reached. 

[0007] Another complexity added to multimedia 
data conversion was streaming data Streaming data is 
the continuous transmission of data over a network. An 

10 example of a use of streaming data was the transmis- 
sion of streaming video and audio over the Internet. 
However, conversion programs did not convert stream- 
ing data as it was received. The conversion programs 
first collected the data and then converted all the data at 

is once. 

[0008] What is needed in the art is a way to manage 
this type of multiple information incompatibility and a 
better way to perform multimedia conversions. 

20 Summary Of The Invention 

[0009] To address the above-discussed deficien- 
cies of the prior art, the present invention provides a 
dynamically configurable system and method for trans- 

25 coding streaming data and a telecommunications infra- 
structure incorporating the system or -the method. In 
one embodiment, the system includes: (1) first, second 
and third streaming conversion modules capable of con- 
verting data stream portions between internal data for- 

30 mats and (2) a transcoding controller, associated with 
the first second and third streaming conversion mod- 
ules, that determines source and destination data for- 
mats of the data stream and arranges ones of the first, 
second and third streaming conversion modules in an 

35 optimal series to convert portions of the data stream 
from the source data format through at least one of the 
internal data formats to the destination data format 
[001 0] The present invention therefore introduces a 
dynamically configurable transcoder system wherein a 

40 controller selects and arranges conversion modules in a 
series to provide conversion from a given source data 
format to a given destination data format. The transcod- 
ing controller selects and places the modules into the 
series in an order that optimizes conversion (according 

45 to speed, cost, fidelity, load or by any other desired 
measure) . Thus, if multiple conversion paths are possi- 
ble, the transcoding controller selects the most optimal 
path/according to pertinent measurements. 
[001 1 ] In one embodiment of the present Invention, 

so the system further includes a configurable buffer, the 
transcoding controller further employing the configura- 
ble buffer to buffer the portions between the ones of the 
first second and third conversion modules in the opti- 
mal series. The configurable buffer may be a shared 

55 memory space logically between the selected conver- 
sion modules. The buffer, while not necessary to the 
present invention, is advantageous when conversion 
speeds or units (to be defined) differ between adjacent 
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modules. 

[001 2] In one embodiment of the present invention, 
the portions are frames of the data stream. In an 
embodiment to be illustrated and described, the por- 
tions may be of any size, from byte to complete stream. 
The portions may also vary in size. 
[0013] In one embodiment of the present invention, 
the portions are less than a conversion unit each of the 
first, second and third conversion modules internally 
buffering the portions to amass a conversion unit. A 
"conversion unit" is defined as the smallest unit of data 
that a particular conversion module can convert at a 
time. Many speech compression algorithms work on 
40ms portions of datastreams. Text-to-speech algo- 
rithms typically operate on a syllable or a word at a time. 
The conversion modules of the present invention there- 
fore may be adapted to accept portions of any length 
and amass portions internally until they have enough 
data (a conversion unit's worth) before converting the 
data. 

[0014] In one embodiment of the present invention, 
the first, second and third conversion modules are 
selected from the group consisting of : (1 ) data compres- 
sion modules, (2) data decompression modules, (3) 
data encryption modules, (4) data decryption modules, 
(5) data format conversion modules, (6) data media 
conversion modules and (7) data signal processing 
modules. Those skilled in the art are aware of the many 
conventional algorithms for data compression/decom- 
pression and encryption/decryption. The present inven- 
tion is adapted to operate with any of these or any later 
developed algorithm. Data format conversion is directed 
to changing the format of the data, rather than the data 
itself. Data media conversion involves changing the 
conveyance of the data, such as text-to-speech conver- 
sion or speech recognition. 

[001 5] . In one embodiment of the present invention, 
the transcoding controller arranges ones of the first, 
second and third streaming conversion modules in at 
least two optimal series concurrently to convert portions 
of the data stream from the source data format through 
at least two of the internal data formats to at least two 
destination data formats. Thus, a data stream in a given 
input data format may be concurrently converted into 
two or more different output data format. Of course, this 
need not be the case. 

[001 6] In one embodiment of the present invention, 
the first, second and third conversion modules are 
embodied in instantiate objects, the transcoding con- 
troller instantiating the ones of the first, second and third 
conversion modules to arrange the ones of the first, sec- 
ond and third streaming conversion modules in the opti- 
mal series. In an embodiment to be illustrated and 
described, the conversion modules and the transcoding 
controller are sequences of instructions, organized into 
objects and executable in a general-purpose data 
processing and storage machine. Of course, the con- 
version modules may not be object-oriented and need 



not be embodied in software. They may instead be dis- 
crete or integrated digital or analog hardware. 

Prief Description Of Tne Prawlogs 

5 

[0017] For a more complete understanding of the 
present invention, reference is now made to the follow- 
ing descriptions taken in conjunction with the accompa- 
nying drawings, in which: 

10 

FIGURE 1 illustrates a block diagram of a telecom- 
munications infrastructure that can serve as an 
environment within which a system or a method 
constructed according to the principles of the 
is present invention may operate; 

FIGURE 2 illustrates a block diagram of a computer 
system that can serve as an environment within 
which a system or a method constructed according 
20 to the principles of the present invention may oper- 
ate; 

FIGURE 3 illustrates a schematic block diagram of 
the CPU of FIGURE 2 incorporating an embodi- 
es ment of the present invention; 

FIGURE 4 illustrates a block diagram of one 
embodiment of a transcoding system constructed 
according to the principles of the present invention; 
30 and 

FIGURE 5 illustrates a flow diagram for converting 
a data stream using the transcoding controller of 
FIGURE 4. 

35 

Detailed Description 

[0018] Referring initially to FIGURE 1 , illustrated is 
a block diagram of a telecommunications infrastructure 

40 100 that can serve as an environment within which a 
system or a method constructed according to the princi- 
ples of the present invention may operate. In one 
embocfiment of the present invention, the invention 
comprises a telephone 110, a messaging computer 

45 120, a facsimile machine 150, a telephone net- 
work/Internet 130 and a transcoding computer system 
140. 

[0019] The telephone network/Internet 130 com- 
prises a gateway that couples a public switched tele- 

50 phone network and the Internet. Connected to the 
telephone network/Internet 130 are the messaging 
computer 120, the telephone 110, the facsimile 
machine 150 and the transcoding computer system 
140. In the illustrated embodiment of the present inven- 

55 tioh, the telecommunications infrastructure 100 may 
comprise any number of telephones 110, messaging 
computers 120 and facsimile machines 150. 
[0020] The telephone 110 communicates over the 



3 



5 



EP 1 026 872 A1 



6 



telephone network/Internet 130 and generates voice 
mail messages used by the transcoding computer sys- 
tem 140. The facsimile machine 150 sends facsimiles 
over the telephone network/Internet 130 to the trans- 
coding computer system 140. The messaging computer 
120 generates electronic mail ("e-mail'') messages, fac- 
simile messages, and voice mail messages. The mes- 
saging computer 120 transmits the generated 
messages over the telephone network/Internet 130 to 
the transcoding computer system 140. 
[0021 ] One skilled in the art should understand that 
the present invention is not limited to using the tele- 
phone network/Internet 130. In another embodiment of 
the present invention, the information to be processed is 
transmitted directly into the transcoding computer sys- 
tem 1 40. In a third embodiment of the present invention, 
the information that is processed by the transcoding 
computer system 140 could be contained within the 
transcoding computer system 140 itself. 
[0022] Turning now to FIGURE 2, illustrated is an 
isometric view of a computer system 200 operating as 
the transcoding computer system 140 of FIGURE 1. 
The computer system 200 may be a conventional per- 
sonal computer ("PC") . The transcoding computer sys- 
tem 140 need not be embodied in a computer system, 
instead, the transcoding computer system 1 40 may take 
the form of a wireless terminal or a telephony interface 
card. 

[0023] The computer system 200 includes a moni- 
tor 210, a chassis 220 and a keyboard 230. Alterna- 
tively, the monitor 210 and the keyboard 230 may be 
replaced by other conventional output and input 
devices, respectively. The chassis 220 includes both a 
floppy disk drive 240 and a hard disk drive 245. The 
floppy disk drive 240 is employed to receive, read and 
write to external disks; the hard disk drive 245 is 
employed for fast access storage and retrieval. The 
floppy disk drive 240 may be replaced by or combined 
with other conventional structures to receive and trans- 
mit data and instructions, including without limitation, 
tape and compact disc drives, telephony systems and 
devices (including videophone, paging and facsimile 
technologies), network interface cards, and serial and 
parallel ports. 

[0024] The chassis 220 is illustrated having a cut- 
away portion that includes a battery 250, a clock 260, a 
central processing unit ("CPU") 270 and a memory stor- 
age device 280. The processing circuitry of the present 
invention may be embodied in the CPU 270 and the 
communications circuitry of the present invention may 
be embodied in the CPU 270 in combination with the 
memory storage device 280. Although the computer 
system 200 is illustrated having a single CPU 270, hard 
disk drive 245 and memory storage device 280, the 
computer system 200 may be equipped with a plurality 
of CPUs and peripheral devices. 
[0025] It should be noted that any conventional 
computer system having at least one CPU that is suita- 



ble to function as a transcoding computer system may 
be replaced, or be used in conjunction with, the compu- 
ter system 200, including without limitation, video- 
phones, telephones, televisions, sophisticated 

5 calculators, and hand-held, laptop/notebook, mini, 
mainframe and supercomputers, including RISC and 
parallel processing architectures, as well as within com- 
puter system network combinations. Conventional com- 
puter system architecture is more fully discussed in 

w Computer Organization and Architecture, by William 
Stallings, MacMillan Publishing Co. (3rd ed. 1993) and 
incorporated herein by reference. Alternative computer 
system embodiments may be firmware-or hardware- 
based. 

is [0026] Turning now to FIGURE 3, illustrated is a 
schematic block diagram of the CPU 270 of FIGURE 2 
incorporating an embodiment of the present invention. 
The CPU 270 is coupled to the memory storage device 
280 by a data bus 31 0. The memory storage device 280 

20 stores data and instructions that the CPU 270 uses to 
execute the functions necessary to operate the compu- 
ter system 200. The memory storage device 280 may 
be any conventional memory storage device. The CPU 
270 includes a control unit 320, an arithmetic logic unit 

25 ("ALU") 330 and a local memory storage device 340 
(e.g., a stackable cache, a plurality of registers, etc.) . 
The control unit 320 fetches the instructions from the 
memory storage device 280. The ALU 330, in turn, per- 
forms a plurality of operations, including addition and 

30 Boolean AND, necessary to carry out the instructions 
fetched from the memory storage device 280. The local 
memory storage device 340 provides a local high speed 
storage location for storing temporary results and con- 
trol information generated and employed by the ALU 

35 330. Again, the processing circuitry of the present 
invention is embodied in the CPU 270 and the transcod- 
ing circuitry of the present invention may be embodied 
in the CPU 270 in combination with the memory storage 
device 280. 

40. [0027] Turning now to FIGURE 4, illustrated is a 
block diagram of one embodiment of a transcoding sys- 
tem constructed according to the principles of the 
present invention. The transcoding system, generally 
designated 400, comprises a transcoding controller 

45 410, a streaming conversion module A 420, a streaming 
conversion module B 430, a streaming conversion mod- 
ule C 440 and a configurable data buffer 450. Coupled 
to the transcoding controller 410 is the streaming con- 
version module A 420, the streaming conversion mod- 

so ule B 430, the streaming conversion module C 440 and 
the configurable data buffer 450. 
[0028] In one embodiment of the present invention, 
the streaming conversion module A 420, the streaming 
conversion module B 430 and the streaming conversion 

55 module C 440 perform at least one of the following: data 
compression, data decompression, data encryption, 
data decryption, data format conversion, data media 
conversion or data signal processing. Each of the 
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streaming conversion modules converts from an input 
format to an associated internal data format. The trans- 
coding system 400 is capable of combining the stream- 
ing conversion modules into a sequence, arranged by 
internal data formats, to convert from a source data for- 
mat to a destination data format. Also, each of the 
streaming conversion modules is capable of buffering 
the incoming data stream internally in order to accom- 
modate the type of processing the streaming conver- 
sion module performs. 

[0029] The transcoding controller 410 is the central 
management mechanism of the transcoding system 
400. The transcoding controller 410 determines the 
source and destination formats of a data stream to be 
converted. In one advantageous embodiment of the 
present invention, the transcoding controller 410 deter- 
mines the source format from the data stream. In 
another embodiment of the present invention, the trans- 
coding controller 410 determines the source and desti- 
nation formats from parameters passed to the 
transcoding controller 41 0. 

[0030] The transcoding controller 410 also deter- 
mines a module conversion type for the streaming con- 
version module A 420, the streaming conversion 
module B 430 and the streaming conversion module C 
440. From these module conversion types, the trans- 
coding controller 410 can determine an optimal 
arrangement of streaming conversion modules to con- 
vert a given source format to a destination format. 
[0031] The advantage of the transcoding controller 
410 is the capability of the transcoding controller 410 to 
determine the "least cost" path. The "least cost" path is 
an optimal arrangement of streaming conversion mod- 
ules that would incur the least estimated processing 
load on the system when the system 400 performs a 
conversion. In one embodiment of the present inven- 
tion, the transcoding controller 410 calculates the least 
cost" path by determining the type of conversion accom- 
plished by each of the streaming conversion modules 
and the amount of system load incurred to complete 
that conversion. The transcoding controller 410 also 
determines the combinations ("paths") of streaming 
conversion modules that can convert from the source 
format to the destination format. For each of the paths, 
the transcoding controller 410 determines a path sys- 
tem load by adding each of the streaming conversion 
modules' system loads together. The transcoding con- 
troller 410 compares the path system loads to deter- 
mine which path will produce the lease amount of load 
or cost on the system. In another embodiment of the 
present invention, the transcoding controller 410 is 
capable of using two optimal series of streaming con- 
version modules concurrently to convert portions of the 
data stream from the source format to a destination for- 
mat. 

[0032] The configurable data buffer 450 is a storage 
area used by the transcoding system 400 in the process 
of converting the data stream from a source format to a 



destination format The transcoding controller 410 allo- 
cates the size of configurable data buffer 450 based 
upon the type of conversion to be performed and the 
number of streaming conversion modules needed for 

5 the conversion process. In one embodiment of the 
present invention, the transcoding controller 410 uses 
the configurable data buffer 450 to buffer the input data 
stream to accommodate streaming data (such as 
streaming video over the Internet) . In another embodi- 

70 ment of the present invention, the configurable data 
buffer 450 is shared memory space accessible by the 
transcoding controller 410, the streaming conversion 
module A 420, the streaming conversion module B 430 
and the streaming conversion module C 440. In a third 

75 embodiment of the present invention, the transcoding 
system 400 may comprise any number of configurable 
data buffers 450. 

[0033] One skilled in the art should know that the 
transcoding controller 410 is not limited to controlling 

20 only 3 streaming conversion modules. In other embodi- 
ments of the present invention, the transcoding system 
400 and the transcoding controller 410 may contain 
additional or fewer functions than described. 
[0034] Turning now to FIGURE 5, illustrated is a 

25 flow diagram for converting a data stream using the 
transcoding controller 410 of FIGURE 4. In FIGURE 5, 
the transcoding controller 410 first performs initialization 
and starts the conversion process in a step 502. 
[0035] After initialization, the transcoding controller 

30 410 determines what streaming conversion modules 
are in the transcoding system 400 and collects their 
associated module information in a step 504. In one 
embodiment of the present invention, the transcoding 
controller 410 also performs statical analysis on each of 

35 the streaming conversion modules. From the statical 
analysis, the transcoding controller 410 determines sys- 
tem load characteristics and conversion times for each 
of the streaming conversion modules. 
[0036] Next, the transcoding controller 410 receives 

40 the data conversion request in a step 506. The trans- 
coding controller 410 then determines a "least cost" 
path for this data conversion request in a step 508. In 
the "least cost" path determination, the transcoding con- 
troller 410 determines the source and destination for- 

45 mat for the data request The transcoding controller 41 0 
also determines which combination of the streaming 
conversion modules will produce the least estimated 
load on the system. The transcoding controller 41 0 also 
allocates a storage area for the configurable data buffer 

so 450. 

[0037] The transcoding controller 410 configures 
the streaming conversion modules in the optimal 
sequence in a step 510. This configuration step com- 
prises linking the inputs and outputs of the streaming 
55 conversion modules to each other in the correct optimal 
sequence in order to convert the data stream from the 
source format to destination format. 
[0038] Next the transcoding controller 410 reads 
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the data stream and passes the information to the cor- 
rect streaming conversion modules in a step 512. The 
streaming conversion modules convert the information 
and store the converted information in the appropriate 
location in a step 514. 

[0039] Next, the transcoding controller 410 then 
determines if the transcoding controller 410 is at the 
end of the data stream in a decisional step 516. If the 
transcoding controller 410 is not at the end of the data 
stream, then the transcoding controller 410 reads more 
data in the step 512. If the transcoding controller 410 is 
at the end of the data stream, the transcoding controller 
410 then stops processing the data conversion request 
in a step 518. 

[0040] One skilled in the art should know that the 
present invention is not limited to using a least cost" 
method for configuring streaming conversion modules 
and that, even if a least cost" method is employed, that 
"cost" can be defined in many different ways. In another 
embodiment of the present invention, the transcoding 
controller 410 may use other algorithms to optimally 
configure the order and use of the streaming conversion 
modules. Other embodiments of the present invention 
may have additional or fewer steps than described 
above. 

[0041] From the above, it is apparent that the 
present invention provides a dynamically configurable 
system and method for transcoding streaming data and 
a telecommunications infrastructure incorporating the 
system or the method. In one embodiment, the system 
includes: (1) first, second and third streaming conver- 
sion modules capable of converting data stream por- 
tions between internal data formats and (2) a 
transcoding controller, associated with the first, second 
and third streaming conversion modules, that deter- 
mines source and destination data formats of the data 
stream and arranges ones of the first, second and third 
streaming conversion modules in an optimal series to 
convert portions of the data stream from the source 
data format through at least one of the internal data for- 
mats to the destination data format. 
[0042] Although the present invention has been 
described in detail, those skilled in the art should under- 
stand that they can make various changes, substitutions 
and alterations herein without departing from the spirit 
and scope of the invention in its broadest form. 

Claims 

1. A system for transcoding a data stream, compris- 
ing: 

first second and third streaming conversion 
modules capable of converting data stream 
portions between internal data formats; and 

a transcoding controller, associated with said 
first, second and third streaming conversion 



modules, that determines source and destina- 
tion data formats of said data stream and 
arranges ones of said first, second and third 
streaming conversion modules in an optimal 
5 series to convert portions of said data stream 

from said source data format through at least 
one of said internal data formats to said desti- 
nation data format 

10 2. The system as recited in Claim 1 further comprising 
a configurable buffer, said transcoding controller 
further employing said configurable buffer to buffer 
said portions between said ones of said first, sec- 
ond and third conversion modules in said optimal 

is series. 

3. The system as recited in Claim 1 wherein said por- 
tions are frames of said data stream. 

20 4. The system as recited in Claim 1 wherein said por- 
tions are less than a conversion unit, each of said 
first, second and third conversion modules inter- 
nally buffering said portions to amass a conversion 
unit. 

25 

5. The system as recited in Claim 1 wherein said first, 
second and third conversion modules are selected 
from the group consisting of: 

30 data compression modules. 

data decompression modules, 

data encryption modules, 

35 

data decryption modules, 
data format conversion modules, 
40 data media conversion modules, and 

data signal processing modules. 

6. The system as recited in Claim 1 wherein said 
45 transcoding controller arranges ones of said first, 

second and third streaming conversion modules in 
at least two optimal series concurrently to convert 
portions of said data stream from said source data 
format through at least two of said internal data for- 
so mats to at least two destination data formats. 

7. The system as recited in Claim 1 wherein said first, 
second and third conversion modules are embod- 
ied in instarrtiable objects, said transcoding corrtrol- 

55 ler instantiating said ones of said first, second and 
third conversion modules to arrange said ones of 
said first second and third streaming conversion 
modules in said optimal series. 
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8. A method of transcoding a data stream, comprising : 

determining source and destination data for- 
mats of said data stream; and 



ing instantiating said ones of said first, second and 
third conversion modules. 

15. A telecommunications infrastructure, comprising: 



arranging ones of first, second and third 
streaming conversion modules capable of con- 
verting data stream portions between internal 
data formats in an optimal series to allow por- 
tions of said data stream to be converted from io 
said source data format through at least one of 
said internal data formats to said destination 
data format. 

9. The method as recited in Claim 8 further compris- 15 
ing buffering said portions between said ones of 
said first second and third conversion modules in . 
said optimal series. 

10. The method as recited in Claim 8 wherein said por- 20 
tions are frames of said data stream. 



a data network; 
a telephone network; 

a gateway coupling said data network and said 
telephone network; and 

a system, associated with said gateway, for 
transcoding a data stream communicated in at 
least one of said data network and said tele- 
phone network, said system being a system as 
claimed in any of claims 1 to 7. 



11. The method as recited in Claim 8 wherein said por- 
tions are less than a conversion unit, said method 
further comprising buffering said portions internally 
within each of said first, second and third conver- 
sion modules to amass a conversion unit. 



25 



12. The method as recited in Claim 8 wherein said first, 
second and third conversion modules are selected 30 
from the group consisting of: 

data compression modules, 

data decompression modules, 35 

data encryption modules, 

data decryption modules, 

40 

data format conversion modules, 

data media conversion modules, and 

data signal processing modules. 45 

13. The method as recited in Claim 8 wherein said 
arranging comprises arranging ones of said first, 
second and third streaming conversion modules in 

at least two optimal series concurrently to allow por- so 
tions of said data stream to be converted from said 
source data format through at least two of said 
internal data formats to at least two destination data 
formats. 

55 

14. The method as recited in Claim 8 wherein said first, 
second and third conversion modules are embod- 
ied in instantiate objects, said arranging compris- 
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